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STRONG  REPRESENTATION  OF  WEAK  CONVERGENCE 

Z.  D.  Bai  and  W.  Q.  Liang 


ABSTRACT 


Let  y  ,  n  =  1,2,...,  and  y  be  a  given  sequence  of  probability  measures 
each  of  which  is  defined  on  a  complete  separable  metric  space  Sn  and  S 
respectively.  Also,  a  sequence  of  measurable  mappings  <t>  from  Sp  into  S 
is  given.  In  this  paper,  it  is  proved  that  if  up  °  “ 1  weakly  converge  to  y 
then  there  is  a  probability  space  (ft,F,P),  on  which  we  can  define  a  sequence 
of  random  elements  Xn,  from  ft  into  Sn,  and  a  random  element  X,  from  ft 
into  S,  such  that  yn  is  the  distribution  of  Xn,  y  is  the  distribution  of 

i 

X  and  lim  <f>n(Xn)  =  X  pointwise. 

n-x» 


The  result  of  Skorokhod  (1956)  is  a  special  case  of  the  result  of  this 
paper.  Some  applications  in  the  area  of  random  matrices,  etc.,  are  also  given 


1.  INTRODUCTION 


'  It  is  well  known  that  there  is  a  big  difference  between  the  concepts  of 
weak  and  strong  convergence  of  random  variables.  In  the  area  of  limiting 
theory,  it  is  of  interest  to  study  the  difference  as  well  as  the  link  between 
the  two  concepts  of  convergence.  Recent  research  work  motivates  us  to  investi¬ 


gate  them.  In  Section  2,  we  shall  prove  the  following  theorem. 

'■t'On  5to»v-.  S*  - 


C  in  ^  (l  / u 

\Wl  1: 


nS, 


THEORtfj_l:  Let  Sn,  n  =  1,2,...,  and  S  be  complete  separable  metric  spaces, 

with  distance  functions  pn  and  p  respectively,  and  let  4>n  be  a  measurable 

mapping  from  Sn  into  S.  Suppose  that  pn  and  u  are  probability  measures 

defined  on  Sn  and  S,  the  Borel  o-fields  deduced  by  the  distances  pn  and  p, 

-1  W 

respectively,  and  suppose  that  yn  •  <f>n  y 


Then  there  is  a  probability  space 
erne 

random  element  X,  defined  on  (ft,F,P),  such  that 


(fi ,F,P)  and  a  sequence  of  S  -valued  random  elements  X„,  and  an  S-valued 

n  n 


1)  Xn  has  distribution  y^  and  X  has  distribution  y, 

2)  lim  <4  (X  )  =  X,  pointwise. 

_  n  n 

n-x» 


In  early  1956,  Skorokhod  proved  a  special  case  of  Theorem  1,  where  Sn  =  S, 
for  each  n,  and  $n  are  all  identity.  It  should  be  pointed  out  that  our 
Theorem  1  is  not  a  trivial  generalization  to  Skorokhod' s  theorem.  Theorem  1 
played  a  key  role  in  the  proof  of  a  theorem  in  Yin  (1984),  but  Skorokhod' s 
theorem  is  not  applicable  there. 

Although  Skorokhod's  paper  was  published  in  early  fifties,  it  seems  that 
Skorokhod's  theorem  had  not  received  much  attention  unfortunately.  For  instance, 
the  Helley-Brary  theorem  can  be  easily  obtained  by  Skorokhod  theorem,  but  in 
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many  recent  probability  textbooks,  it  was  still  proved  by  the  approach  of 
integration  by  parts.  Even  though  the  proof  of  Skorokhod's  theorem  seems  a 
little  complicated,  we  can  give  a  very  simple  proof  to  the  special  case  where 
Sn  =  S  =  R^,  the  finite  dimensional  Euclidean  space. 

The  power  of  Theorem  1  appears  in  the  situation  that  we  often 
encounter  in  large  sample  theory.  Suppose  that  $n(Yn)  ^  and  F(*,»)  is 

a  two-variate  continuous  function.  We  are  concerned  with  the  limiting  behavior 

of  the  roots  of  the  equation  F(4>n(  Yp)  ,X)  =  0.  In  general,  the  roots  of 

F(y,X)  =  0  do  not  have  an  obvious  expression,  but  in  many  cases  we  can  prove 

that  the  solution  x  =  x(y)  is  continuous  in  y.  In  these  cases,  by  Theorem 

1,  we  only  need  to  investigate  the  behavior  of  the  solution  of  F($,x)  =  0. 

Some  concrete  examples  can  be  found  in  Bai  (1984),  Bai  and  Yin  (1984)  and 

Yin  (1984). 

We  generalized  Lusin's  theorem  to  the  measurable  mapping  from  a  complete 
separable  metric  space  into  another  one.  This  result  is  stated  in  Theorem  2 
and  it  played  a  key  role  in  the  proof  of  Theorem  1. 


2.  A  GENERALIZATION  OF  SKOROKHOD'S  THEOREM 


We  first  assume  that  each  <j>n  is  continuous.  At  the  beginning,  we 

construct  a  series  of  countable  partitions  of  the  space  S  as  follows: 

Let  B(x,r)  denote  the  ball  in  S,  with  center  x  and  radius  r. 

Because  S  is  separable,  there  is  a  countable  set  {x^,  i  =  1,2,...},  which 

is  dense  in  S.  Because  there  are  at  most  countably  many  values  of  r  such 

that  u(3B(x..  ,r))  >  0,  for  some  i,  where  sB  denotes  the  boundary  of  the 

set  B.  Thus  for  each  k,  there  exists  r^,  2"^k+1^  <  rk  <  2~k,  being  such 

that  u(aB(xi,rk))  =  0  for  any  i  =  1,2,...  .  Write  C(k,l)  =  8 (x.,^), 

C(k,i )  =  B(x.,r.)\U  B(x.,rJ,  and  set 
i  K  j=1  J  K 


D. 

i 


lY'^k 


C(J-V 


ID 


for  any  i^ig,...,^  =  1,2,... 
the  following  properties: 


It  is  obvious  that  (D.  .  }  satisfies 

V  "’k 


2)  D 


*  U  D  .  ,  S  =  0  D.  , 


1 1  *  *  * 1 k- 1  ik=l  1li2’'-,,1k 


VI  ^ 


3)  u(3D.  ,  )  =  °, 

1r  ■  ‘ 'k 


(2) 


4) 


d(0.  .  )  <  2  ,  where  d(D)  denotes  the  diameter  of  the  set 

V --’k 
D. 


Using  the  same  approach,  for  each  n,  we  split  Sn  into  partitions 


4 


).•  *  i  }  having  similar  properties  as  {D.  .  .  }. 

Vf2 . Tk 


Wri  te 


<n)  .  (J-, _ J„)  -  D?n)  .  n*-lD. 

1 1  ’  ‘  ’ '  ’ 1  k  1  k  1 1  ”  "  ’ 1  k  * '  n  J 1  ’  *  •  *  •  J  | 


pi1!...,ik(jl,'"’V  =  un(Di1!...,ik(jl’”*’Jk^' 


It  is  obvious  that  d(D 


i  i  <Ji . Jk))  <  2"k- 

1 1  ***** 1 k  1  K 


Let  Q  =  [0,1),  F  be  the  o-field  of  all  Borel  sets  in  n,  and  P  be 
the  Lebesgue  measure  restricted  on  F. 

Split  into  partitions  {lfn^  .  (j.,...,j.)}  with  the  following 

1 1*  •  • •  »  I  k  1  K  J 

properties: 


1)  Each  ij  .  is  an  interval  closed  from  left 

r*‘  k  fnl 

and  open  from  right,  and  has  length  p.  .  (j, , . .  • ,  j.) . 

h . \  1  k 


2).  For  each  n  and  each  k,  {lfn^ 


partition  of  [0,1). 


.  ,•  ( j, .... . )>  is  a 

1 1  ”  ‘  ’ 1  k  1  k 


3)  ij"j  i  (jj . jk-1)  -  0  u  i!n)  i  (j 

1 1  1  k-l  1  k  1  ik=l  jk-l  h . \ 


i . V 


4)  If  ik  <  ik,  for  any  1  x ***** i k_  j »  J X ’ *  -  * » J k ’  Ji” 
I.-n^  i  is  located  on  the  left  of 

1  1  »  •  •  •  >  I  k  *  K 


T ' n /  .  (  i  1  1') 

1r*-**1k-r1k  1  k 
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5)  If  Jt  <  t  <_  k,  then  for  any  ij,. ..  ,ik,  •• 

Jt+1»*  ••  ,jk,  ljn^  ^  is  located  on  the  left  of 

I  k 


k* 


I i 


(n) 


i1,. ..  ,ik  VJ1 


4  ( j  i  >  •  •  • » j*  j  >  » •  •  • » Ji,)  • 


We  take  a  point  .  (j, ,. . .  artibrarily  from  .  ( j, , . 

1  ^  j  •  •  •  j  1 1  k  ^l****,'k  ^ 


• 


if  it  is  not  empty  and  define 


xnk,(w)  =  ’V’  lf  “  e  1  i  ^ ! . . . ,  i  k 


(6) 


Evidently,  for  each  n  and  k,  Xp  is  measurable.  Because 


D1 


(n) 


M . Vi 


(j- 


jr...  Jk+l^Oijl...  ,ik  (jl . V 


and 


we  have 


d  (Di"i...  ,ik  ’V)  <  2  ^ 
pn(Xnk)(“)»  xik+1)(w))  "  2_k* 


(7) 


/Y(k) 


Thus  for  each  n,  {X^ k  =  1,2,...}  forms  a  Cauchy  sequence  and  there  exists 

a  measurable  function  X„  such  that 

n 


X^)  .*  x  .  k  -*>  «.  v 

n  n 


■-0  L.  J  t  j 


(8) 


because  Sn  is  complete.  Therefore,  we  have  defined  an  Sn~valued  random 


element  Xn  for  each  n. 


1 


A’.V. 


Next,  we  shall  prove  that  un  is  the  distribution  of  Xn<  Take  any  open 
set  An^CSn>  define  A^  =  {x^  e  An;  pn(x^,3An)  >  ^} ,  wl  ere  m  is  a 
positive  integer  and  sAn  is  the  boundary  of  An  and 

Pn(x^,B)  =  inf{pn(x^  ,y^n^  ,y^  e  B).  It  is  obvious  that  for  each  pair 

(n,m),  A^  n  is  an  open  set  contained  in  Ap  >  and  Am  nCAm+1  n<  Thus  we 

have  an  expression  of  A  „  as  follows 

m,n 


[  0<n)(j, )  +  [  D<">  (j  ,j  )  +  ...  (9) 


where  win^,  win^,...  are  suitable  index  sets  and  all  the  right  hand  side 
l,m  2,m 

terms  are  disjoint  each  other. 

-k+l  1 

For  each  k  with  2  <  — ?  ,  we  have 

2m 

o„(:<„.n‘k))  <  (|)k"!  <  ~Tz  ■ 

n  n  n  ‘  .  2m 


Hence 


( X  e  A  )<=WKI  e  Am  n)C.(Xn  e  A  ). 
n  m-l,n  n  m^n  n  m^l>n 


p(\'WiT'Ui'(VW' 


On  the  other  hand,  we  have 


P(X(k)  e  A  )  =  I  P(X^k)  e  D^UJ) 

m’n  M  i  L\  w(n)  n  h  1 


u  /  \ 
(11’12;j1J2^N2,m 


P<*n  .  D<">  (jrj2))  * 


l  ,  ,  I I{")U1)| 


0  *•  "  »  *  »  *  «  *  •  ’  •  *  k  *  .  .  '*  »"•  .  *  ,  '  -  K  “  »  - 

-V  •-*  vT  .V  v*  Ov*  V*  mj"  •  *  .  “  J^V  k-"  »  •  *  -  5  k.  J 


*.  .%  \  *  V  >  - 


T-TTTTr 


I  j«  «■  |  ■  |  ■!  ivaiimvi 


rr-  *yy9ymy 


(")  u 


*  .  .  }.  w "i^'vyi * ■ 

(’r  VJrJVeW2,m 


}  (B1  u»(Di")(Jl,) 

(lj.jllsNj  > 


(n) 


\.  J.tM  ^V^))  +  - 


(iri2;jrj2)eW2>in 


v  (A  ). 
n  m,n 


From  (11)  and  (12)  it  follows  that 


(12) 


P(Xn  *  Vl,n>  i  i  P<X„  E  Vl,n>  i  P<Xn  E  V'  <13> 


If  we  let  m  -*■  «,  we  obviously  have  A  ,  +  A  ,  A  t  A  .  Hence  from 

m-l,n  n  m,n  n 

(13)  we  get 


p(Xn  E  An>  "  “n<V 


Therefore,  u  is  the  distribution  of  X  ,  for  each  n. 
n  n 


(14) 


Wri  te 


p,r-",1k 


,  *  u(D,  <  ), 


(1 . \ 


and  split  n  into  partitions  (I.  .  }  such  that 

V***,1k 


1)  for  each  k,  {I.  •  ,  i . , . . .  ,i  -  1 ,2, . . . }  is  a  partition 

1r--*,1k  1  k 

Of  ft , 
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2)  each  I.  •  is  an  interval  closed  from  left  and  open  from 

’I . ’k 

right,  with  its  length  p.  .  , 

1 1  * '  ‘  ’ 1  k 


3) 


I.  ,  =  u  l-  -i  » 

V-'-’Vl  i ,  =1  71 . 7k 


4)  if  i  <  i ’ ,  then  I.  .  is  located  on  the  left  of 

k  k  1 1  ”  ’ '  *  ‘  k 


I. 


1 1  ’  *  *  *  ’ 1  k- 1 1  k 


We  arbitrarily  take  a  point  x.  .  from  D.  •  for  each 

( i ^ , . . . ,i k)  and  define 


X(k)  =  x.  ,  ,  if  w  e  I 

V*’  k 


1 1  ’ '  *  •  ’ 7  k 


Similarly  as  before,  we  can  prove  that  there  exists  an  S-valued  random  element 
X  such  that 


P(X(k),X)  <  2~ k , 


(15) 


and  that  u  is  the  distribution  of  X. 


To  complete  the  proof  of  the  special  case  of  Theorem  1,  vie  need  only 
to  prove  that 

4>n  ( )  ■*  X ,  a .  s . 


(16) 


Wri  te 


d"1  ,  *  u  ...  u  ii"'  ,  (Jj . jk) 

1 1  ’  ’  ’  ’  ’ 1  k  jj=i  jk=i  1r--,,1k  1  k 


(n) 


According  to  the  definition  of  I 


(n) 


. V- 

Ik  lk 

analogous  properties  as  {L  •  },  and  their  length  satisfies 

’l . ’k 


}  has 


9 


r(n)  i=  y  y  /n(n )  fi 

l  i  I  L  l  vi  (D.  .•  U,  »•  •  •  »J|J  J 

'v\  jx=i  jk=i  n  1i*-**,1k  1  k 


=  u„u:1(d.  , 

n  n  1 1  >  •  •  • » i  k 


- 1  W 

Since  u(aD.  .  )  =  0  and  y  <*>  ■*  y ,  we  have 

i  - » . . . ,  i ,  nn 


l\n)  ,  j  y(D.  ,  ),  as  n 

1r**,,1k  1  i  *  ■  ■  ■ k 


(17) 


If  oj  is  a  point  of  a  and  is  not  an  endpoint  of  any  interval  I.  .  , 

k  =  1,2,...,  i.,...,i.  =  1,2,...,  then  for  each  k  there  exists  a  k-multiple 

(a,,..., a.  )  such  that  w  is  an  inner  point  of  I  .In  view  of  the 

i  k  “l  *  ‘  ‘  ’“k 

definition  of  { I .  •  },  we  know  that  the  left  and  right  endpoints  of 

I  are 

V---’Qk 


V1 


a2~ 1 


V1 


ak  =  I  u(D  )  +  [  u(D  )+...+  V  y(D  •  ) 

k  i , - 1  nl  i0=l  al  2  i.=l  “l"'“k-l  k 


and 


b  =  a  +  y(D  ) 

K  K 


Similarly,  the  two  endpoints  of  are 

ccr...,ak 


o  i  “  1  a0~l  a  k“l 


ifn^  =  \  I  ifn^i  +  V  [  I^nl  I  +  ...  + 


if1  U 


i  2=  1  “l1  2 


l  I  1 


(n) 


ik=i  Jr**‘*'xk-rk 


23 


( N  _•  + 1 )  £ 

_ J _ 


y  .  , _ 

j=l  2J+1(N1,...,Nj+l) 


<  £. 


Finally,  we  shall  prove  that 


e  Sj  ,  i>£(x)  is  discontinuous  at  xj  =  0. 


If  x  £  (K0°)°  f' ^  ,  ...,a  .  for  some  kQ  and  ^  ^  # 


to  the  definition  of  $  (x) 

Mz)  =  ya  a  5  for  any  z  e 

c  V  ••  ’akn-l  u 

U  CO 

Hence  i>(x)  is  continuous  at  x.  If  x  s  ij  ,  then  for  any 

s  k=l  u 

exists  a  k-ple  (a.,..., a.)  such  that  x  e  K  ,  a,  <  N, 

1  K  9  •  •  •  *CC|^  ^  ^ 


1  » ■ ' *  -1 

1  0  1 


Since  K 


is  an  open  set,  we  have  that  pi  x,  ?K 
lk  \  “! . “ 


If  y  t  S,  and  o(x,y)  <  c.  ,  then  y  e  K 

1  *  U1  5  •  •  • 


Hence 


and 


P  (*k(x) 
°  ^*k(y) 


*k(x)  =  $k(y). 

o(*e(x)  ,  6e(y))  <  l/2k'2. 


accord i ng 


k,  there 


Thereto  re , 


22 


21 


20 


We  have 


k  .  1  k 

i(U  Kn>  1  ^si\U 

M  0  1  xipi  v1 


< 


V1 


’.I  ,  w(Gi_ 


V1 


+ 


ir1 


Nk 

...  1 

V1 


u  ( 4>  1D. 


»i 


k-1 


) 


+  N1>...,Nk  e/2k+1(N1,...,Nk  +  l)2 


'1 


Vl 


-lr 


2k+1  ii=1.« 


L  l  u^D,  i  V 

=  1”  "  ’ik_i=1  I’-  ***  k-1  \ 


x  Ki 

•»Vl  Vl .  k-1 


2k+1(Nlf...,Nk  +  1) 


N 


1 


Vl 


V 


I  u(e,  ,  \k,  i  : 

i,  =1  1 1  '  ’’Vl  x  4 . 'k-1 


'k-1 
N 


l  ... 


k-1 


V1 


'I  u(6  ^D,  .  \  K.  .  ) 

i  “sl  V-'-’Vl  \  11’”  ’  ’  k-2 


'k-1 


19 


By  the  definition  of  <J>^  and  we  get  that 


<MX)  =  yn  «  £  Da  '  a 


^k+l(X^  ~  ct  6  £  a  B  a 

K+i  ctj  .  ,a^  d^+2  cij  »•  •  •  >ct^  o ^ j  ~  «2  ’* '  *  ,a|i 


Therefore 


P^k(x),  Vl^j)  <  2 


-k 


Thus  there  must  be  a  limit  point,  denoted  by  <J>  (x),  of  the  sequence  d>k ( x ) . 

Combining  this  and  (26)  we  obtain  that  Tim  <t>k(x)  =  <J> e(x)  pointwise. 

k-**> 

Now  we  shall  prove  that 


(27) 


Note 


y^<f>e(x)  f  4(x)^  <  e. 

00 

that  if  x  x  U  Kq,  we  always  have 


(28) 


o^<J>£(x)  ,  $k(x)^  <  l/2k_1,  for  any  k  _>  1. 


(29) 


Therefore,  for  any  k 


uf  of  *e(x)  ,  «(x)^ 


>  l/2k”2/  <  y 


KqI  + 


k=l 


+  u  (  o  ( \ (x) 


1  "k 

,  «f>(x)j  >  r  r  ,  x  e  l)  , . . .  ,  1)  K .  • 

/  2K_i  rzx  ij^i  h . ^ 


(30) 
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5)  K.  i  i  -  G.  ,  ,,  K.  •  2  =  (G-  .  2\G.  •  ,) 

V-’-’Vi  V'^’Vi1  i . Vr  'i . \-r  V****  Vr 

V1 

»•••»  K.  •  nj  *  (Gj  •  jy  \  ij  i  )  • 

’l . Vl  k  1l”**’1k-l  k  V.,  1l****,1k 

V 


6)  K*  = 


M1  Nk-1 


° =  .U  ■■■  Mi (Kii . vA  M  S---1! 

li"*  ■ i-  i  “i  1 1-  * 


7)  <Ok(x)  = 


'k-l 


h . \ 


4>k_i(x) 


if  x  e  K.  -  1  <  i ,  <  W1  , . . .  ,1  <  i.  £  W. 

1 1  *  *  *  *  * '  k  1  K  K 

if  x  £  kJ(J...(Jk£. 


If  x  e  KqU  for  some  kQ,  then  for  any  k  >  kQ 


4>k(x)  =  <ik  (x) 

x  xQ 


(26) 


M,  N. 


^  M  U  K0’ 

k-l 


1  k 

because  KkQ[J,. . .  ,{Jk.  ^  ,  C.  SjX^'1  )(J“  *  *  ’UK0* 

il=1  V1 

W1  Nk 

then  for  any  k,  x  e  I  I  ...  I  I  K.  .  .  Suppose  that  x  £  K  , 

\m00s  'w  ij*****'^  ™  ^ 


and  x  e  K 


6^ ,. . .  ,B 


V1  V1 

Since  K, 


k+1  8l’-**’sk+l  “l**** ,wk+l 


cz  K 


Si , . .  •  »£ 


and  K 


.  .  's  are  disjoint,  it  follows  that  3,  =  a,,...,  =  a.. 
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Write 


n2-i 


K.  .  -  G.  ,,  K.  ?  =  (G  AG.  K.  N  =  (6.  N \Q  G  .  )°, 

V  V  V  h2  V  hN2  V2  Vai  V2 


and 


,2  „ 


^  KV; 


Define 


4>2(x)  = 


yi1i2  if  x  e  Ki1i2’  1  -  *1  -  Nl*  1  -  i2  -  N2’ 

11  •  l„2 


^(x)  if  x  e  KqLJk2. 

l6t  Eiii2i3  =  Kili2^  lDi l12i3a  1  5  5  Nl'  1  1  ^  -  V 

3 

i  <  i,  <  W  Similarly  define  G.  .  .  ,  K.  .  .  Kn  and  <|>o(x).  By 

—  o  —  3  1 1 1 21 3  1 1'2 '3  *  ^  ^ 


Then 


induction  we  can  define  E 


i  i  »  &i  i  i  » 

'17 . 1  >!>••* 


i  ,  KQ  ,  <J>k(x) 


satisfying  the  following  relations: 


n  Ei  i  -  k  i 


rvv 


.  ,  l<i,  <  N«  i.,<N 


i  i  »  A  _  ‘i  _ 

•  1  9  •  •  •  >  1  L,  1  A 


k  -  Hk" 


2)  G 


JX  Q  I 

[  i  ***** 1  k~~  1 1  ”  *  * ,1  k-1  ’  1r****'lk 


s  are  open  sets. 


3)  u(G.  •  A  E-  T  )  <  e/2  (N,  . ,Nk 

1r***1k  1  ’•  *  *  ’  k 


k+1,‘’  ,N.+1)2 


4)  uOGi  .  )  =  0 
•  • » 'k 
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Let  E.  =  4>  D.  .  For  each  i1f  there  is  an  open  set  G.  such  that 

h  h  1  h 


U(3G.  )  =  0 
’l 


Wri  te 


and  Ki  = 


u(G.  A  E.  )  <  e/4(N1+l)^. 

h  h  1 

Nj-1 

K,  =  G,,  K2  =  (GAG,)0,...,  1C,  «  (G  MJ  G.  )° 

N1 

K.j ,  where  A  denotes  the  interior  of  the  set  A.  Define 


y,-  if  x  e  K;  ii  1  > •  •  •  »N I 

h  V  2  1 


y°  if  x  e  Kq. 


Secondly,  let  E,  .  =  K.  0<J>_1(D.  ,  ).  Then  there  exist  open  sets 

V2  ’l  V2 

ij  <  ,  i2  £  N2,  such  that 

^  Gili2C:  KlV  ^  =  *2  = 

2)  “<G11i2  A  Cli2>  <  M(HlVl)2, 


3)  u(9G<  .  )  =  0. 

1112 


<f>n ( Xn )  -*■  X ,  a. s . ,  n  . 


As  before,  we  can  make  a  slight  modification  on  Xp  and  X  so  that  (25) 
holds  pointwise.  Theorem  1  is  proved. 

Now  we  turn  to  prove  Theorem  2.  Suppose  that  and  S2  are  two 
complete  separable  metric  spaces,  y  is  a  finite  measure  defined  on 
Sj,  <j>:  S1  -*•  S2  is  a  measurable  mapping. 

Using  the  same  approach,  we  split  S2  into  a  sequence  of  partitions 
{D.  .  i\,...,i,  =  1,2,...},  k  *  1,2,...  such  that 


).  =  U  D- 

1l*****1k-l  1k-l  ’l . V 


k  =  2,3,... 


S2  -  U  D.  , 
2  VI  ’1 


and  d(D-  .  )  <  1/2"  .  For  any  fixed  e  >  0,  we  can  select  a  sequence 

of  positive  integers  such  that 

N1  Nk 

i^=1‘”i J=1  Di1,...,ik)  >  +  f  +'”+  Ji5r)  =  “  t  +  JkT 


for  any  k  =  1,2,...  .  Without  any  loss  of  generality,  we  can  assume  that 
each  D.  .  is  nonempty,  i,  =  1 , . . . ,  N, ,. . .  ,it  =  1,...,N.  .  Arbitrarily 

1  £  9  •  •  •  i  1  *  * 

take  yij,. . .  ,ii.  e  °i  1 , . . .  ,iL ,  i  1  <  Ni ,. .  .iu  <  Nu,  and  y°  e  S9. 


On  the  other  hand,  it  is  obvious  that 


<t>-1B  A  df1  B  D 
vn  vn  ' —  n 


where  A  A  B  denotes  (a\b)|^J(^\A)  .  Thus  we  have 


I  Vn1  B  -  Vn*  8  I  -  “A*8  A  V'  8  >  i  W  i  jit  *  °> 


as  n  -*■  « . 


Therefore  (24)  follows  from  the  above  estimate  and  the  fact  that  +  u 

n  n 

According  to  the  special  case  that  we  just  proved,  we  can  find  a  probability 

space  (ft,*  F,  P)  on  which  there  is  a  sequence  of  random  elements  X  and  X 

»  " 

such  that 

1)  yn  is  the  distribution  of  Xn,  y  is  the  distribution  of  X, 

2)  d>n(Xn)  -*■  X  pointwise. 

Since 


l  P(w:  <j)  (X  (uj))  f  d> n(X(u))) 
n  =  1  n  n  n 


s  I  ,  Vx  e  Sn  *n(x)  f  ^n(x)) 
n  =  1 


<  l  ~ 

n  =  1  2n 


=  1  <  00  , 


by  Borel-Cantelli  lemma  we  know  that 


Example:  Let  =  [0,1]  with  Euclidean  norm  and  Lebesgue  measure,  and  let 
=  {0,1}  with  p(0,l)  =  1.  Define 

*eSi 

where  1^  denotes  the  indicator  of  the  set  A.  For  any  e  <  i,  we  cannot 
find  a  continuous  mapping  <t>£:  -*•  satisfying  (22). 

A  little  more  complex  example  yields  from  the  above  example  with  the 
measure  replaced  by  y: 

U(B)  •  {  L  (B)  ♦  rJtg  -ij,  BcB([0.1]), 


where  L(B)  is  the  Lebesque  measure  of  the  set  B  and  Q  =  {rn,  n  =  1,2,...} 
is  the  set  of  all  rational  numbers  in  [0,1], 

Before  we  prove  Theorem  2,  we  first  use  Theorem  2  to  complete  the  proof 
of  Theorem  1.  For  each  n,  according  to  Theorem  2,  there  exists  a  measurable 
mapping  ^  such  that 

D  PnUn  t  Jn)  <  i/2n, 

2)  yn(x  e  Sn;  $n  is  discontinuous  at  x)  =  0. 


We  shall  first  prove  that 


7-1  W 

Vn  *  “• 


Let  B  be  a  Borel  subset  of  S  and  Bn  =  §n  =  <jT*B.  Denote  by 

D  =  {x  e  S  .  (x)  f  (x)}.  By  the  definition  of  <L,  we  have  u  (D  1  < 


Since  P(N)  =  0,  Xn  and  Xn  (correspondingly  X  and  X  )  have  the  same 
distribution.  Thus  Theorem  1  holds  when  $  are  all  continuous. 

Note  that  the  continuity  of  <£n  is  only  used  in  deriving  that 

p(<i>n(Xn)  ,<J>n(xJ|mh)  ■+  0,  as  m  -*■  «, 

(see  (20)  and  (21)).  We  can  relax  the  continuity  restriction  as  the  following 

up{x  e  Sn;  <bn  is  discontinuous  at  x}  =  0, 

for  each  n.  Therefore,  to  complete  the  proof  of  Theorem  1,  we  only  need  the 
following  generalized  Lusin's  Theorem. 

THEOREM  2:  Let  and  S2  be  two  complete  separable  metric  spaces,  y  be 
a  finite  measure  defined  S1  and  let  <J>  be  a  measurable  mapping  from 
into  S2.  Then  for  any  e  >  0,  there  exists  a  measurable  mapping  Sj  -*•  $£, 
satisfying 

1)  uU  t  Pe)  <  c,  (22) 

2)  y(x  e  S, ,  6  is  discontinuous  at  x)  =  0.  (23) 

1  € 

Remark:  The  main  difference  between  Theorem  2  and  the  ordinary  Lusin's  Theorem 
is  the  condition  (23).  But  in  the  general  case,  we  cannot  require  that  ^  is 
continuous.  This  can  be  seen  from  the  following  example: 


From  this  and  <i  (X'  '(to))  e  D  ,  we  get 

n  n  ot^  •  •  •  otj^ 

’(0n(xW(o,)),  ^(X<k)(W))  <  2'k. 

From  (19)  and  (20),  we  get 

p(*n(Xn(u)),X( *»))  £  3.2"k  +  p($n(Xn(w)),4»n(xJm)(w))), 


Since  <J>n  is  continuous  and  X^  '(to)  -*■  X  (to) ,  m  •>  =°,  it  follows  that 


p( <i>n( Xn( oj)  )  ,X((jj) )  <  3  *2  . 

This  proves  (16)  because  the  set  of  all  endpoints  of  I. 

1 1  ’*'  *  ^k ’ 

k  =  1,2,...,  i  >•*•  »i|<  =  is  countable,  hence  its  Lebesgue  measure  is 

zero. 

Let  N be  the  set  on  which  <t>n(Xn(uj))  do  not  converge  to  X(<o) 

and  let  4>n(Xn(ojg) )  X(wq).  Define  a  new  sequence  of  random  elements 
as  follows: 


xnM  = 


XU)  = 


*„<“> 

if 

to 

z  9  \ 

W 

if 

CO 

e  M 

X(u) 

if 

to 

e  Cl  \ 

Xt^g) 

if 

(0 

z  N 

Then  we  have 


<f'n(Xn(aj))  -*■  X (c.j)  pointwise. 


v  v  %•  < 


From  (17)  we  have  that 


and 


a(n)  , 

k,  k  (n  -*■  00 ) 

-*•  bk  (n  -*■  ®) 

(n) 


Therefore,  when  n  is  large  enough  to  e  Ix  ' 

'  Qij  >  •  •  • 


^(xik)(W))  e  D 
n  n  ctj.  •  • 


Note  that  X^(w)  e  D 


CXj  )  •  <  •  ,CX|^ 


,■*  we  get 


pU„(X<,k)M),  X(k>U))  <  2"k. 


From  (15)  and  (18)  it  follows  that 


c (4n(X<k)M),  X(w))  <  2’W 


For  fixed  n  and  k,  and  for  any  m  >  k,  there  exist 


Such  that  w  e  .  Thus  we  have 

al”  **  ,ak’ak+l’“  ’  ,am 


. ^OXIf. 


or 


e  D 


Hence 


ak+l’ak+2 


,  ) 

•  ,ak 


Since  k  is  arbitrary,  we  have  proved  that  <j>  (x)  is  continuous  at  x. 

ThUS  N.  N„ 

”1  k 

u(x  e  S  ,  <j>  (x)  is  discontinuous  at  x)  _<  £  £  1  v(3K.  .  ) 

e  k=1  V1  V1  11 . ’k 

This  completes  the  proof  of  Theorem  2. 

3.  A  SIMPLE  PROOF  OF  THEOREM  1  FOR  THE  FINITE  DIMENSION  CASE. 

3.1  ONE  DIMENSION  CASE 

Suppose  that  Fn  and  F  are  one-dimensional  distributions  satisfying 
that  Fp  X  F  as  n  -  «.  Let  0  =  (0,1).  F  =  8(0,1)  and  P  be  the 
Lebesque  measure  restricted  on  n.  Define 

X  U)  =  Sup{x:  Fn(x)  <  w}  ,  oj  e  a  -  (0,1), 
and 

X(w)  =  Sup{x:  F(x)  <  x}. 

According  to  this  definition,  it  is  evident  that  XnU)  £  x,  ^  t  fi, 
x  e  R'  is  equivalent  to  the  fact  that  Fn(x)  _>  u.  This  ensures  that  Fp 
is  the  distribution  of  X  .  Similarly,  F  is  the  distribution  of  X. 

For  any  w  e(0,l),  take  arbitrarily  Xg  <  XU)  and  xQ  is  a 
continuous  point  of  F(x).  Then  F(xq)  <  u.  Since  Xg  is 

a  continuous  point  of  F(x)  and  Fn  -H-  F,  we  have  Fn(xg)  — *  F(xg).  Thus 
when  n  is  large  enough  we  have  Fn(xg)  <  u>,  so  that  XnU)  _>  Xg.  Hence 
X(w)  <  lim  X  U)  for  any  w  e(0,l). 
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Let  u  s(0,l)  be  such  that  for  any  e  >  0,  F  X(o)  +  e  >  Take  e  >  0  such 

that  X(<o)  +  e  is  a  continuous  point  of  F(x).  Since  Fn  ^X(u)  +  + 

F  ^X(u)  +  >  oj,  when  n  is  large  enough  we  have  Fn  ^X(<o)  +  z'j  >  u. 

Thus,  according  to  the  definition  of  X  (to)  ,  Xn(w)  £  X (to)  +  e.  This  shows 

that  lim  X  (to)  £  X(to).  Hence,  lim  Xn(u>)  =  X(to).  If  for  some  to  e(0,1), 
n-x»  n-*<° 

there  exists  a  constant  eg  >  0  such  that  to  «  F  ^X (to)  +  eg^j  ,  then  for  any. 


0  <  e  <  eg,  F  ^X(jj)  +  egj  £  F  ^X(to)  +  tj  _>  to  =  F  ^X(io)  +  £g  J  Hence 

F  ^X(to)  +  zj  =  F  (X(to)  +  Eg  )-  Thus  there  exists  a  rational  number 
y  -  y(to)  e  ^X(w)  ,  X (to)  +  Eg^  ,  corresponding  to  to.  If  there  are  two  points 

toj  <  ^2  which  correspond  to  ,  y 2  respectively  *  we  shall  prove  that 

Yj  <  y2-  In  fact,  if  ^  =  F  (x(to.j)  +  E.)  ,  e.  >  0,  1  -  1,  2,  then 

X('Oj)  +  Ej  £  X(to2).  Otherwise,  XjOo^)  £  X (tog )  <  X(to^)  +  e^  £  X (to^)  +  e2  would 

imply  that  Uj  =  F  ^X(toj)  +  e^  =  F^X(u>2)  +  =  -o2,  contradicting  to  the 

assumption  that  <oj  <  tog.  Thus  there  are  at  most  countably  many  u>  such 


that  Xn(to)  •  £•*•  X(c 0).  Hence 


X  (oi)  — *•  X(to)  a-s  ,  n 


As  before,  we  can  change  the  definition  of  X  (to)  and  of  X(<o)  at 


those  10' s  at  which  X  (u)  -y*  x(v.),  so  that 


X  (w)  — *■  X(to)  pointwise,  n  ■+  ». 


3.2  TWO  DIMENSION  CASE 

Let  F^(*  ,  •)  and  F(*  ,  ♦)  be  two-dimensional  distributions  such 
that  F^  F  ,  n  ■>  ».  Let  F^(*)  and  F ^,n ^ ( * [ x)  denote  the  marginal 

distribution  of  the  first  component  and  the  conditional  distribution  of  the 
second  component  when  given  the  first  component  to  be  x,  corresponding  to 
F^n^ .  Define  random  vectors  (Xn  ,  Y  )  on  n  =  (0,1)  x  (0,1)  as  follows: 


We  can  similarly  define  random  vector  {X,  Y}.  As  before  we  can  show  that 
{Xn(uj)  1  x  >  Yn^ul'w2^  -  1S  equivalent  to 

{F^n)(x)  >  wx  ,  Fjn)  (y|Xn(«j))  >  u>2),  and  that 

'».!>  *fX  (X>Fvn)  d“l 

o'  7 

X 

=  [  F^n)(y|t)  F^n)(dt)  =  Fp(x  ,  y). 

CO 

Similarly,  F(»  ,  •)  is  the  distribution  of  (X  ,  Y).  Using  the  conclusion 
in  3.1 ,  we  have 

KM  — *  XK)  a.s. 


with  respect  to  the  one-dimensional  Lebesque  measure  restricted  on  (0}1). 

By  Fubini's  Theorem,  we  know  that 

with  respect  to  the  two-dimensional  Lebesque  measure  restricted  on  (0.1)  x  (0^1) 
Again  using  the  conclusion  about  one  dimension  case,  for  any  fixed  e  (0,1), 
we  get  that 

Yn(a)1,a)2)  - ►  Y (oj ^  ,ui2 )  3*S. 

with  respect  to  the  one-dimensional  Lebesque  measure  restricted  on  (0,1). 

Again  using  Fubini's  Theorem,  we  obtain 

Yp^Wjju^)  ——*■  a.s. 


with  respect  to  the  two-dimensional  Lebesque  measure  restricted  on  (0,1)  x  (0,1) 
For  d-dimension  case,  the  proof  is  the  same  as  in  two-dimension  case. 
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4.  APPLICATIONS  OF  THEOREM  1 

4.1  HELLEY-BRAY  THEOREM  ([2]  and  [4]). 

If  F  F  and  q{x)  is  a  continuous  bounded  function,  then 
n 


g(x)F(dx) 


PROOF.  Construct  Xp  ~  Fp  ,  X  -  F  and  Xn  — *  X,  according  to  Theorem  1. 
Then  by  the  dominated  convergence  theorem  we  have 


jg(x)Fn(dx)  =  Eg(Xn) 


Eg(x)  = 


(g(x)F(dx) 


4.2  (See  [4]) 

If  Fn-^  F,  then  fn(t)  — *■  f ( t )  uniformly  on  any  bounded  interval, 

where  fn  and  f  are  the  characteristic  functions  of  Fn  and  F,  respectively. 
PROOF. 

Let  T  >  0  be  any  fixed  number.  Then 


i  tX 

|fn(t)  -  f(t)|  =  | E(e  n  -  eltX)i 
<_  EieU^Xn'X^  -  1| 

<  2P( ! Xn  -  Xi  >  e/T)  +  e  —  £  ,  V-  |t!  <  T. 
Hence  | f n(t )  -  f(t)|  — *  0  uniformly  on  [-T,  T]. 
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PROOF. 

Let  Xn  ~  Fn ,  X  ~  F  and  Xn  ->  X.  Then  what  to  be  proved  is  equivalent 
to 


E|X|r<!jm  E|X  |r. 

n-w° 

The  latter  is  just  a  special  case  of  Fatou  Lemma. 


4.4 

If  {X  }  converges  in  distribution  to  F  ,  Yn  to  Ea,  the  degenerate 

n  n  a 

distribution  concentrating  its  mass  at  a,  and  Zn  converges  to  Eb  ,  b  >  0, 

then  {(Xn  +  Yn)Zn)  converges  in  distribution  to  G(x)  =  F(|  -  a)  (See  [4], 

Th. 4.4.6  and  the  corollary  after  it). 

PROOF. 

Since  {(X  ,  Y  ,  Z  )}  converges  in  distribution  to  F(x)Ea(y)E.  (z). 

n  n  n  q  D 

By  Theorem  1,  we  can  construct  (Z  ,  Y_  ,  Z  )  — *  (Z  ,  a  ,  b)  -  F(x)Ea(y)E, (z) 

n  n  n  o  d 

Thus  (Zn  +  Y  )Z  — >  (z+a)b  -  F(^  -  a).  Q.E.D. 


I 


Though  the  original  proofs  of  the  above  four  results  are  not  very 


complicated,  the  proofs  given  here  are  relatively  easier.  In  the  following 
examples,  the  proofs  will  be  involved  with  much  difficulty  if  you  do  not 
use  Theorem  1. 


4.5  (See  [1],  [7]  and  [8]). 


Suppose  that  {W.m.,  1  <  i  <  p,  1  <  j  <  k-l}1M‘{W  1  <  1  <  P, 

'  J  *  J 

1  <  j  <  k-1 }  and  that  {uW  ,  1  <  i  <  j  <  P}1^*  {U. .  ,  1  <  1  <  j  <  P}. 

*  <3  ^  J 

Consider  the  detrimental  equation 

det  d  WW'  -  Lcm  +  D  -  ±  Um)  =  0, 

m  m  m  m  VT  m 

where  Wm  =  j|w™.||  :  px(k-l)  ,  Um  =||u \f\\  :  pxp,  with  U<J}  =  uj^. 


-*I 

p-r  | 


>(m)  r(m).r(m)' 


1 

>)  =  Vx  W(m)  +  if  \  ~  W(n>)  +i  _  ,-1 

Lgh  V  9  ij  ^  h  wij  j1  ah-l  1  ’ •  * '  ,ah  ’  -1  ag-l 


•  •  •  »3g  j  1  <  h  <  g  <  v 


r(m)  - 


Wij  »  i  r  +  ,  j  =  ah-1  +  1,...  ,a^ 


a0=0  *  ah  =  ah-l  +  uh  ’  h  =  1*2,... ,v.  av  =  r  <  P  ,  Xj  >,...,>v>0. 

Let  21  > •  -  *  »il  il  0  be  roots  of  this  determinantal  equation  and  let 


z|m)  -  Xh),  1  =  ah-1  4  1 . ah,  h  =  1,2 . v,  and  l\m)  = 


i  =  r+  1 .  ,p.  Then  the  joint  distrubution  of  (zjm' . .Z^' )  tends 


distribution  to  that  of  Z.t...tZn  ,  where  Za  Za  are  the  roots  of 

l  p  ah-i  1  “  “  ah 


det(Chh  +  xhUh  *  ZIyh}  B  0  .  h  «  l,2,...,v, 


and  Z  ,  _>>•••  >1  Z  are  the  roots  of 


where 


det(|ldJI  -  ZIp-r>  *  °’ 


Ckk  ‘  ||  VWij  +  >  1  ’  ■*  =  ah-l  +  1 . ah. 


Uii  ’  j  =  ah-l  +  1 . ah  ’  Uij  =  Uji 


3 ij  =  £4+i  Wie  Wj£  *  1  ’  d  ”  r  +  1  *•  •  •  ,p‘ 
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PROOF. 

According  to  Theorem  1,  without  loss  of  generality,  we  can  assume  that 
—v  W.  .  and  — >  U,.  pointwise.  The  explicit  proof  refers 

to  [8]  and  is  omitted  here. 

4.6  (See  [2],  [5],  [6]) 


Suppose  that  (xnl  ,*n2 >• • •  .Xnk)  — -  (X2 . Xfc)  for  any  k,  and  that 

00  00  eo 

lim  Tim  £  |X  , |  =  0  in  probability,  £  X  and 


nl<i  -  u  m  \n uuau 1 1 1 i,jr ,  i  A^k  aim  i  Xk  a.s.  converges. 


K-*»  rv»»  k=K  k=l  ,,N  k 


Also  suppose  that  gk(t)  is  uniformly  bounded  in  k  and  t.  Then  the  sequence 

oo 

of  stochastic  processes  \  Xnk^k^  weakly  converges  to  the  stochastic 

k-1 

oo 

process  \  X.g.(t). 
k=l  K  K 


PROOF. 


CO 

Set  S  =  (xj.Xg,... ,):  \ 


k=l 


xkl  <  »}.  Define 


0  I ( x |  ,  x^,...,)  ,  (y1  ,  y9,. . . ,) 


T 


l  !xk-yki .  Then  it  is  easy  to  see 


k=l 


that  S  is  a  complete  separable  metric  space  and  (Xp^  ,  X^,...) 
(X^  ,  X2,...,)  are  random  elements  on  S  with  property 


(Xpjj ,  •  • .  •  ■ » )  (Xj,...,  xk’"..»). 


According  to  Theorem  1,  we  can  assume  that  this  convergence  is  true  pointwise. 
It  is  not  difficult  to  show  that 


J,  Xnk  9k(t)  "  xk9k(t' 


i M  knxnk-xki  *  °-  a-s- 


and  the  proof  is  complete. 


For  details  of  this  example,  the  reader  is  referred  to  Bai  and  Yin  (1984). 

The  proof  of  Theorem  5.2  given  there  can  be  greatly  simplified  by  using  Theorem  1. 

In  all  the  above  examples,  we  can  use  Skorokhod's  Theorem.  In  the  following 
we  shall  give  an  example  to  show  that  Skorokhod's  Theorem  is  unappli cable. 

4.7 

Suppose  that  Xp  =  (X.j):  pxn  and  Tp  =  (tj^)  satisfy 

1)  (X. .  ,i, j =1 ,2 , . are  i.i.d.  random  variables  with  mean  zero  and 

•  vJ 

2 

variance  a  >  0. 

2)  For  each  p,  Tp  is  a  non^negative  definite  random  matrix. 

3)  Xp  is  independent  of  Tp. 

4)  -pj  trace  t  J*  -  in  ■P— +  H.  as  p  -*■  for  each  k. 

P  P  K 

5)  £  — *  y  e  (0  ,  »)  ,  P  -*•  ®. 

Then  for  any  k  _>  1 

^  trace  (I  Xn  X'  T)k  — *  E.  in  pr. 
p  n  p  p  p  k 

where  E^  is  a  constant  depending  only  upon  a  ,  y  and  (See  [9]). 

PROOF. 

nn  +  I 

Take  Sp  =  R  p  2  P(P+1),  the  Euclidean  Space 

1  i  k 

t D  =  (-r  trace  T  ,  i  =  l,2,...,k}:  S  » — *  [0  ,  <*>)  and  j  the  measure  on 

Sp,  derived  by  (Xp  ,  Tp). 
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By  the  assumptions  we  have 

,-l  JL  p 

yp  *P  (Hx . Hk)‘ 

Thus,  we  can  assume,  by  Theorem  1,  that  for  fixed  k, 

{-jjj-  trace  Tp  ,  i  =  1 ,2 ,. . .  ,fc)  — *•  {H1 ,. . .  ,H pointwise. 

After  truncation  and  centralization  on  {X..  ,  i  ,  j=l, 2, 

'  \J 

we  can  prove  that 

E[i  trace  {I  Xp  X-  l/|Tp]  -  Efc  . 
and 

^£([1  trace  ti  X*p  Tp>k  -  HklZ!Tp>  <  <• 

where  X  =  MX^M  ,  pxn  and  X^  is  the  random  variable  obtained  from 
p  1 1  ij 1  1  r  i  j 

X^  by  truncation  and  centralization.  Thus 


4  trace  4  Xn  X’  T)k 
P  P  P  P  P 


Ek,  a.s. 


and  consequently 


4  trace  (4  Xn  X’  T  }k 
P  p  p  p  p 


Ek,  a.s. 


Since  we  have  used  Theorem  1,  the  above  expression  only  implies  that  the  convergence 
to  be  proved  is  true  in  probability.  The  details  of  the  proof  can  refer  to  [9]. 

Note  that  in  this  example  Skorohod's  Theorem  is  unappl icable,  because  Sp, 
defined  here,  is  not  the  same. 
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